LAVa: Layer-wise KV Cache Eviction with Dynamic Budget Allocation
arxiv.org·12h
🧠LLM Inference
How Can AI Companies Protect On-Device AI Models and Deliver Updates Efficiently?
reddit.com·16h·
Discuss: r/LocalLLaMA
📊Model Serving Economics
AI hardware reimagined for lower energy use
techxplore.com·3h
⚡Hardware Acceleration
Language Models Pack Billions of Concepts into 12,000 Dimensions
nickyoder.com·13h·
Discuss: Lobsters, Hacker News
🎯Vector Quantization
How To Build Agentic AI That Ships
thenewstack.io·2h
📊Model Serving Economics
Down and out with Cerebras Code
infoworld.com·7h
💾Prompt Caching
Analog IMC Attention Mechanism For Fast And Energy-Efficient LLMs (FZJ, RWTH Aachen)
semiengineering.com·44m
🧠LLM Inference
How next-gen laptops use NPUs for massive power savings
nordot.app·6h
🖥️Hardware Architecture
Supercharge Your Docker Compose Applications with AI Models
ajeetraina.com·10h
🆕New AI
Conquering the LLM Memory Wall: How to Run 2–4x Longer Contexts with a Single Line of Code
reddit.com·5h·
Discuss: r/LocalLLaMA
🧠LLM Inference
AI search optimization tools: Geoptie’s all-in-one GEO dashboard is live by Tor.app
searchengineland.com·5h
📊Feed Optimization
Securing and Scaling AI-Powered APIs
capestart.com·3h·
Discuss: Hacker News
🧠Inference Serving
Productive AI Programming Using Forced Context Distillation
jx0.ca·4h·
Discuss: Hacker News
🪄Prompt Engineering
[CS 2881r AI Safety] [Week 1] Introduction
lesswrong.com·20h
🛡️AI Safety
LLM Rerankers for RAG: A Practical Guide
fin.ai·19h·
Discuss: Hacker News, Hacker News
🏆Ranking
AI Agent Development Trends 2025: Insights from 542 Projects
greenice.net·1h·
Discuss: Hacker News
🆕New AI
Demis Hassabis en el podcast Release Notes
domingogallardo.bearblog.dev·22h
🆕New AI
Cloud CISO Perspectives: APAC security leaders speak out on AI and key topics
cloud.google.com·58m
🌐Distributed systems
An AI-Powered Development Workflow for Solo Builders
spin.atomicobject.com·4h
🪄Prompt Engineering
Google Pixel 10 Pro review: one of the very best smaller phones
theguardian.com·10h
📱New tech trends